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We construct games of chance from simpler games of chance. We show that it may 
happen that the simpler games of chance are fair or unfavourable to a player and 
yet the new combined game is favourable - this is a counter-intuitive phenomenon 
known as Parrondo's paradox. We observe that all of the games in question are 
random walks in periodic environments (RWPE) when viewed on the proper time 
scale. Consequently, we use RWPE techniques to derive conditions under which 
Parrondo's paradox occurs. 
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1. Introduction 

Parrondian strategies are where losing games can cooperate to win (Harmer & Ab- 
bott 1999a). The original example of Parrondo's games consist of two coin tossing 
games. Game A consists of Coin 1 biased to lose. Game B consists of two coins - 
Coin 2 with losing bias and Coin 3 with winning bias - but a state-dependent rule 
is chosen to favour the losing Coin 2. Hence both games A and B are losing games. 
However when A and B are alternated in a deterministic or even random manner, 
the player surprisingly has a winning expectation. This effect has been interpreted 
in terms of a discrete-time Brownian ratchet, at length, elsewhere (Harmer & Ab- 
bott 19996) - where conventional Brownian ratchets (Doering 1995) have been the 
inspiration. An alternative view, we call the Boston interpretation (Stanley 1999, 
group discussion), recognises that although game B favours Coin 2 with losing bias, 
if the state-dependence is removed game B now favours the winning Coin 3 - then 
when games A and B are mixed, game A has the affect of randomisation or 'break- 
up' of game B's state-dependence, thus tilting favour towards Coin 3 with winning 
bias. This explanation was also independently deduced by J. Maynard Smith (1999, 
personal communication). Further to the ratchet interpretation and Boston inter- 
pretation, this paper will examine another viewpoint by considering the process as 
a random walk in a periodic environment (RWPE). 

We now briefly summarise the literature on Parrondo's games. In (Harmer et 
al. 2000a) the state-dependent rule, for game B, is to choose Coin 2 if the player's 
capital is a multiple of some integer M - analysis showed the paradox could hold 
for general values of M . In (Pearce, 2000a) it is shown that the paradox can hold 
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when both games A and B are multiple coin games. In (Pearce 20006) we have the 
first analysis of Parrondo's games in terms of Shannon entropy and in (Harmcr et 
al. 20006) the entropy parameter spaces are graphically displayed. The probability 
parameter space is shown in (Harmer et al. 2000c). In (Lee et al. 2000) a minimal 
three-state game with asymmetric transition probabilities is analysed and in (Par- 
rondo et al. 2000) state-dependence on capital is replaced by dependence on the 
past history of the game, leading to a larger probability parameter space. 

The surge of interest in analysing Parrondian games is motivated by a number 
of areas. Information theorists have long studied the problem of producing a fair 
game from biased coins (Gargamo and Vaccaro 1999) and the roots of this can 
be traced back to the work of von Neumann (1951) - Parrondo's games go a step 
further in producing a winning game from losing games. Seigman (1999, personal 
communication) has reinterpreted 'capital' of the games in terms electron occupan- 
cies of energy levels - the paradox can then be reproduced using the rate equation 
approach typically used in laser analysis. In the physical world there are many 
types of processes where losing helps to win, such as a sacrifice in the game of chess 
or a valley in the fitness landscape of an animal species. Many biological effects 
are linked to ratchet type phenomena and Westerhoff et al. (1986) have analysed 
enzyme transport with a four-state model. Applicability to population genetics, 
evolution and economics has been suggested (McClintock 1999). In finance, Maslov 
and Zhang (1998) have shown that under certain conditions capital can grow by 
investing in an asset with negative typical growth rate. Quantum ratchets have now 
been experimentally realised (Linke et al. 1999) and recasting Parrondian games, 
based on ratchet phenomena, as quantum games (Eisert et al. 1999; Goldenberg et 
al. 1999; Meyer 1999) is thus of interest. 

In control theory, it can be shown that the combination of two unstable systems 
can become stable (Allison & Abbott 2000). Velocity of propagation through an 
array of coupled oscillators, under certain conditions, can increase even though the 
damping coefficient is increased (Sarmiento et al. 1999). In the area of granular flow, 
drift can occur in a counter-intuitive direction such as exemplified in the famous 
Brazil nut paradox (Rosato et al. 1987). Also declining branching processes can be 
combined to increase (Key 1987). Plaskota (1996) shows that noisy information can 
sometimes be better than clean information. In (Pinsky and Scheutzow 1992) it is 
shown that with switched diffusion processes in random media it is possible to get 
a positive-recurrent processes (i.e. with no drift) from mixed transient processes 
(i.e. with drifts all in the same direction) - this is almost certainly a continuous 
time analogue to the Parrondian discrete-time process. Assuming we construct Par- 
rondo's games to only deal in transactions of one unit of capital per event, then we 
have a skip-free process, and a statistical interpretation of the central result is that 
declining birth-death processes can be combined to form an increase. 

In this paper we further investigate Parrondo's paradox. We construct a class of 
composite games and investigate their fairness by formulating the problem in the 
language of random walks in periodic environments (RWPE). We find many new, 
interesting, and counter-intuitive results. 
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2. Mathematical tools 

We construct a composite game from two simple games A and B. These two games 
can be combined in two ways: deterministically or stochastically. 

If we have played n times, and n is divisible by k (for an integer k), we then 
play game A. If we have played n times and n is not divisible by k, we play game 
B. Thus games A and B are alternated in a deterministic pattern. We denote by 
Y n our capital after n plays of this game. 

To alternate games A and B randomly we toss a coin with probability p of 
heads. If the coin comes up heads, we play game A, and if tails, we play game B. 
We denote by Z n be our capital after n repetitions. 

The sequence of values of our capital in either of these games is a Markov random 
walk which changes by ±1 in each epoch. The two random walks Z n and Y n differ 
in that Z n is time homogeneous, while Y n is not time homogeneous. Moreover, Z n 
is a random walk in a periodic environment. The process Y n is not a RWPE, but 
the process Y r [ = Y kn is a RWPE. 

As shown in §4 we extend this construction to define composite games from 
more than two simple games. In each case we identify the capital of the player as 
a RWPE. 

We say that a game is fair, winning or losing if the random walk for the capital 
of a player, X n , is recurrent or transient to oo, or to — oo, respectively. That is, a 
Markov chain X n is 

recurrent (fair) if P{— oo = lim inf X n < lim sup X n = 00} = 1; 

ri >oo n — > qq 

transient to 00 (winning) if P{ lim X n = +00} = 1; 

n— >oc 

transient to -00 (losing) if P{ lim X n = — 00}= 1. 

71 — >0O 

We note that the characterisation of a game as fair, winning, or losing by the 
traditional comparisons E[X n+1 \ X n ] = X n , E[X n+ i\X n ] > X n , and E[X n+ i \X n ] < 
X n , respectively, does not cover the behaviour all random walks, in particular 
RWPE's. 

(a) Key's criterion 

We consider a time homogeneous random walk, X n , in an iV-periodic environ- 
ment, or equivalently we have a state dependent random game W. We assume 
that the maximal step size in the positive direction is R, while in the negative 
direction it is L, that is P{X n+ i e {— L + k, . . . , x + R}\X n = k} = 1. More- 
over, for each k the maximum right and left step sizes are always possible, that is, 
P{X n+1 = —L + k,\X n = k}P{X n+1 = R + k\X n = k} > 0. Given the environment, 
the walk X n obeys the backward master equation 

R 

P{- \X n = k}= <k,j)P{- \X n+1 = j + k}, (2.1) 

3=-L 

where e(k,j) = P{X n+ i = j+k\X n = k) denotes the transition probability from 
the state k to j + k in one time epoch. We denote by fk-i = P{- \X n+ i = k — i} 
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(since X n is time homogeneous / does not depend on n) and rewrite equation 
( EM) as a system for the vector [f-L+k, f-L+i+k, ■ ■ ■ , fR-i+k] T with the matrix 
Afc whose entries given by 



m4mJ = 



-e(k,-L + j)/e(k,-L) ifi = l,j?L 

(l-e(k,0))/e(k,-L) i£i = l,j = L 

1 iti>2,j = i- 

otherwise 



We also define the matrix M = A1A2 . . . A„. 

According to (Key 1984) we define constants dj, i = 1, 2, . . . R + L as follows. 
For each eigenvalue of M (including multiplicities), we put di — log(|Aj|), and 
we list the d^s in increasing order, so that d\ < d% < . . . < c^r+l- Then 

if ln(c(W)) = d R + d R+ i > then the RWPE X n is transient to 00; 

if ln(c(W)) = d R + d R+ i = then the RWPE X n is recurrent ; 

if ln(c(W)) = d R + d R+ i < then the RWPE X n is transient to - 00. (2.2) 

It is shown in (Key&Klosek 2000) that X n is recurrent if the characteristic 
polynomial of M has a double root at 1. 



3. Games composed of 2-periodic games 

First we consider an example of two 2-periodic games P = (Pq,Pi) and Q = 
(QcbQi); that is, we have two RWPE's, each of them 2-periodic (in space). If X n 
denotes the capital of a player at time n which plays the game according to the 
rule P, then the transition probabilities are given by 



P{X n+1 = x + l\X n = x} = 



po if x = mod 2 
Pi if x = 1 mod 2 



vsv ,|y / 1-Po ifx = 0mod2 

P{X n+1 = x - 1 \X„ = x\ = i 1 jo t 3 - 1 ) 

[ 1 — pi if x = 1 mod 2 

that is, if the capital is even it changes according to Po, and it is odd it changes 
according to Pi - cf. figure 1. The transition probabilities for the RWPE governed 



by Q are given by formulas analogous to (3.1), with p's replaced by q's, with the 
rule Qo and Qi at the even and odd positions, respectively. 

To employ the criterion of (Key 1984) to the RWPE governed by P we construct 
the matrix M 



1/(1 -Po) -Po/(l-Po) ' 

1 

Since here R = L = 1, d R + d R+ \ = d\ + d^ = log(| det(M)|), so we find that 
the RWPE governed by P is transient to —00, recurrent, or transient to +00 if 

c(P) = c(P ,Pi) = ^-tt- r < (=)(>)!• We note that this analysis easily 

_ (1 -po)(l -Pi) 
extends to any period N of the environment - cf. §4. 



M = A1A0 



1/(1 -Pi) -Pi/(1-Pi) 
1 
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win lose win lose 



Figure 1. Schematic representation of a 2-(state) periodic game P = (Po,Pi). Games 
composed of such games are discussed in §3. 

(a) An example of a pseudo-paradox 

We suppose that the games P and Q are fair, that is c(Po,Pi) = po(l — 
Po)/(Pi(l - Pi)) = 1 and c (Qo,Qi) = ?o(l - 9o)/(gi(l - gi)) = 1. If we alter- 
nate (deterministically) games P and Q in that very order, then, starting at the 
origin, the composite game may be fair (losing) (winning) if c(P, Q) = pogi/((l — 
po)(l — qi)) = (<)(>) 1. Under this strategy we play the game Po when the win- 
nings are even and the game Q\ when the winnings are odd. The games P\ and 
Qo are never played. Hence c(P,Q) = c(Pq,Qi), and the fact that the composite 
game is losing when it is constructed from two winning games is just an apparent 
paradox. If we play the same two games when starting at an odd position then 
c(P, Q) = c(Pi,Qo) = 1/c(Pq, Qi), and we have a winning game constructed out 
of two winning games. 



(b) Effects of randomisation 

Now we construct a RWPE, X n , by choosing at random between P and Q. If 
our capital is even then a coin with probability of heads go is used to choose whether 
the game Po or Qq will be played; if our capital is odd then a coin with probability 
of heads gi is used to choose between the games Pi and Q\. In this scheme all four 
games are played. The transition probabilities are given by 

my . 1 1 v \ / 9oPo + (1 - .9o)<7o if x = mod 2 

P{X n+ i = X + 1 A n = x) = < } ( . (3.2) 

I 9iPi + (1 - 9iM if x = 1 mod 2 

The fairness of the composite game is determined by the factor c(P, Q) given 

by 



x 90P0 + (1 - .90 go glgl + 1 - .91 gl fo o\ 

c P, Q) = — — . 3.3) 

(1 - 9qPo - (1 - 9oW) (1 - 9iPi ~ (1 - 9im) 



By direct simplification of equation ( |3.3| ) we observe that if go = g\ (and the 
games P and Q are fair) then the composite game is fair. Also, if p\ — q\ then 
the composite game is fair. However, for other values of parameters two fair games 
can be used to compose a game which is winning, losing or fair depending on how 
the two simple games are randomised. Figure 2 illustrates this statement. That is, 
randomisation can produce Parrondo's paradox. 
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Figure 2. We take tw o 2-periodic fair games with p 1 = 1/2 and q 1 — 1/4, and plot 



c(P, Q) — 1 in Eq.(3.3) as a function of gi for various values of go; that is, the composite 
game is winning for positive values on the graph, and losing for negative values. We have: 
dashes: go = 0; crosses: go = 1/8; boxes: go = 1/2; solid: go = 1. 



We also consider a game composed from two unfair games P and Q. Games P 
and Q are taken to be unfair the same way; that is both are losing or both are 
winning. We note that when one coin is used to choose whether P or Q is played, 
(i.e., when g = gi in equation (3.2)) then the composed game is always unfair. 
However, if two coins are used then the randomised game may be winning when 
both simple games P and Q are losing. This example of Parrondo's paradox is 
illustrated in figure 3. 



(c) Three 2-periodic games 

We consider three 2-periodic games P, Q and R, each denned analogously to 
([j~l|), with transition probabilities given in terms of Po,Pi, Soi^i) an d r 'cb r 'i> re- 
spectively. We construct the composite game PQR. We investigate whether the 
composite game may be winning (losing) if the individual games P, Q and R are 
fair. If the capital of the player at time n is X n then the capital at times 3n, 
Y n = X^n, is a random walk in a 2-periodic environment, taking steps of ±3, ±1. 
Specifically, we have 
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Figure 3. We take two 2-periodic losing gam es with po = 0.675, pi = 0.1, qi = 0.75 and 
plot the fairness curve c(P, Q) = 1 in Eq.(|3.3]) in the (<?i,5o) plane for various values of go: 
circles: go = 0; dashes: qo — 0.075; boxes: qo = 0.125; solid: go = 0.175; crosses: go = 0.225; 
diamonds: go = 0.25. The composite game is winning when go and gi are selected above 
the fairness curve. 



P{Y n+1 = x + 3|Y n = x} = 
P{Y n+1 = x- 3\Y n =x} = 



ag = poqiro if x = mod 2 
a± = piqori if x = 1 mod 2 

6 = (l-po)(l-gi)(l-r Q ) if a; = mod 2 
b l = (1 -pi)(l -q ){l ~n) if a; = 1 mod 2 
P{Y n+1 = x + l\Y n = x} = 

co =Po3i(l - ro) +Po(l - qi)r + (1 -po)q\ra if x = mod 2 
ci =_pig (l - n) +pi(l - qo)n + (1 ~Pi)qori if at = 1 mod 2 
P{r„ +1 =a;-l|r„=a;} = 

fd = (1 -po)(l - ?i)ro + (1 -Po)?i(l ~ r ) +Po(l - -r ) x = mod 2 
\di = (1 - go)'"! + (1 -Pi)?o(l - n) - 9o)(l -n) a; = 1 mod 2. 



Moreover, the random walk Z„ = Ym is an ordinary random walk, that is a 
sum of iid random variables taking values ±6, ±4, ±2, and 0, and the transition 
probabilities are 
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win lose win lose win lose 



Figure 4. Schematic representation of a 3-(state) periodic game P = (Po, -Pi, ^2)- Games 
composed of such games are discussed in §4. 



P{Z n , 


-1 


= z 


+ 6\Z n = 


z} = a ai 




P{Z n , 


-1 


= z 


- G\Z n = 


z] = b bi 




P{Z n ^ 


-1 


= z 


+ 4|Z„ = 


z} = a Q a 


+ c ai 


P{Z n - 


-1 


= z 


-4\Z n = 


z} = b di 


+ d bi 


P{Z n - 


-1 


= z 


+ 2\Z n = 


z) = C Ci 


+ a d\ + aido 


P{Z n - 


-1 


= z 


— 2|Z„ = 


z} = dodi 


+ b ci + h c 


P{Z n - 


-1 




Z„ = z} ■■ 


= d ci + dic + a Q b 1 + a\b 



If the games P, Q and R are fair, then by direct calculations, EZ n = 0, so the 
composite game is fair, and there is no paradox in this case. 

4. Games composed of 3-periodic games 

We consider games composed of 3-periodic games P, Q, and R. We define a 3- 
periodic game P = (Pq,Pi,P2) by its transition probabilities as 



P{X n 



Po if x — mod 3 
l\X n — x} = < p\ if x = 1 mod 3 
P2 if x = 2 mod 3 



(4.1) 



compare figure 4. Transition probabilities of the games Q and R are defined by 
formulas analogous to (hi) with p's replaced by g's and r's, respectively. According 
to (Key 1984), to determine the fairness of the game P we consider the product of 
the eigenvalues of the matrix M = Ai A2A0 where 



If 

ning). 



A. t = 
P0P1P2 



(1 - Po )(l - Pl )(l - P2 ) 



1/(1 - Pi ) - Pl /(l-p l ) 1 

^ t — u, 1, z. 

= (<)(>)! then the game P is fair (losing) (win- 
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(a) Two 3-periodic games 

To analyse a game (P, Q), where P and Q are 3-periodic games, we construct 
a random walk Y n = X 2n where X n denotes the position of the walker at time n. 
The transition probabilities for Y n are given by 



P{Y n+1 =x + 2\Y n = x} 



aa = Poqi 
ai = Piq2 
a-2 = P2Qo 



if x = mod 3 
if x = 1 mod 3 
if x = 2 mod 3 



P{Y n+1 = x\Y n =x} = 



ba = Po(l - 9i) + (1 - Po)<?2 
6i =pi(l- q 2 ) + (1 -pi)go 
h =P2(1 - go) + (1 ~P2)qi 



if x = mod 3 
if x = 1 mod 3 
if x = 2 mod 3 



p{y„ +1 = x - 2|y„ = z} 



co = (1 -po)(l - 92) 
ci = (1 - qo) 

C2 = (1 -P2)(l - 9i) 



if x = mod 3 
if x = 1 mod 3 
if x = 2 mod 3. 



Hence, Y n is a 3-periodic random walk taking steps ±2 and zero. To employ 
Key's criterion most efficiently we observe that it is sufficient to analyse Y n as a 
RWPE on the even integers which visits only nearest neighbours. To this end we 
construct the 2x2 matrix M = A1A2A0 where 



A, = 



(1 - bi)la 
1 



-a»/cj 




i = 0,1,2. 



The determinant of M is given by det(M) = _PoPiP2?o?i ( J , 2/[(1 — i?o)(l — — 
P2)(l — 9o)(l — — 92)]- Hence, if the games P and Q are fair, the composite 
game is fair and no paradox is observed. 

We note that this reduction in the dimension of M occurs whenever the temporal 
period is even, since the step sizes of the derived process Y n are even. Specifically, 
if the temporal period is T is even then M can be taken to be the product of T x T 
matrices, and when the temporal period T is odd, then M is the product of 2T x 2T 
matrices. 



(b) Two 3-periodic games randomised 

We construct a composite game from two 3-periodic random games P = (P , 
Pi, P2) and Q = (Qo,Qi,Q2) by selecting at random the game to be played at 
each step, with probability of playing Pi equal to g i: i = 0, 1,2. That is, we define 
a 3-periodic random walk Y n taking values ±1 with transition probabilities 



= goPo + (1 - 9o)qo if x = mod 3 
P{Y n+1 =x + l\Y n = x}= { Pl = giPl + (1 - gi ) qi ifx = lmod3 . (4.2) 

= g2P2 + (1 - 52)92 if x = 2 mod 3 

The walk Y n is recurrent (transient to 00) (transient to — 00) according to 

c(P, Q) = P0P1P2 = (>)(<)! Wc investigate the value of c(P, Q) 

(1 - Po)(l - Pi)(l - P2) 
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Figure 5. We take two fair 3-periodic games with g\ = Q2, Pi = P2 — 1/2, and qi = qi- 
For a fixed value of q\ we plot curves along which the composite game is fair, in the space 
(gi,go)- As qi varies from to 1/2 the composite game is losing above and winning below 
its corresponding "fairness" curve; solid: qi = 0; boxes: qi = 1/6; crosses: qi = 1/3; dashes: 
the line go = gi- As qi varies from 1/2 to 1 the composite game is winning below and 
losing above its corresponding "fairness" curve. In this case the problem is symmetric, so 
that we have: solid: qi — 1; boxes qi = 5/6; crosses: q\ = 2/3. 



for various values of the parameters. We note that if the games P and Q are fair 
with pi = p 2 = qi = q2 then the randomised composite game is fair for all possible 
choices of gi 's. Next we take two fair games with fixed values pi — P2 and qi = q2, 
that is P = (Po,fi,fi) and Q = {Q , Qi, Qi). 

We investigate how randomisation affects the fairness of the composite game. As 
shown in figure 5 there is a wide range of parameters for which the randomised game 
is unfair, so that randomisation induces the paradox. We note that the range of the 
randomisation parameters g's is affected by the way games P and Q are structured. 
In the examples illustrated in figure 6 we take two fair games P = (Pq ,Pi,Pi) and 
Q = (Qo,Qi,Qo) and we note that the range of parameters go,gi = .92 for which 
the randomised game composed from these "shifted" games is larger compared to 
the previous "not-shifted" case - cf. figures 5 and 6. 



(c) Three 3-periodic games 

First we construct a game (PQR) in which the 3-periodic games P, Q and R 
are played in a deterministic order. We show that if all three games are fair then the 
resulting game may be losing. We also show that if all three games are winning then 
the composite game may be losing. If X n denotes the winnings of the composite 
game at time n then its transition probabilities are given by 
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Figure 6. We take two fair 3-periodic games with g 1 = gi, P\ = P2 = 1/2, an d qo = qi- 
We plot the curves along which the composite game is fair in the space (<?i,<7o), for a 
fixed value of qo. As 50 varies from to 1/2, the game is winning above and losing below 
each of its "fairness" curves; solid: qo = 0; circles: qo = 1/12; boxes: qo = 1/6; crosses: 
qo = 1/3; dashes: the line go = gi- As qo increases from 1/2 to 1 the game is losing above 
and winning below its fairness curve. The case of this example is symmetric so that we 
have: crosses: qo = 2/3; boxes: go = 5/6; circles: qo = 11/12. 



if x = mod 3 then 
P{X n+3 =x + 3\X n = x} = a = p qir 2 
P{X n+3 =x- 3\X n = x} = b = (1 -po)(l - q 2 ) (1 - ri) 
P{X n+3 = x + l\X n = x} = c = 

Po(l - I2)n + (1 -p a )q 2 {l - r ) +p (l - - r ) 
P{X n+3 = x - l\X n = x} = d = 

(1 -Po)(l - 92)^1 + (1 -j)o)92(l - r ) +Po(l - - r ) 



if x = 1 mod 3 then 
P{X n+3 = x + 3\X n = x} = ai = piq 2 ro 
P{X n+3 = x - 3\X n = x} = h = (1 -pi)(l - 9o)(l - r 2 ) 
P{X n+3 = x + l\X n = x) = ci = piq 2 (l - r ) +Pi(l - g , 2)?'i + (1 -Pijqon 
P{X n+3 = x-l\X n = x} = d 1 = 

(1 -pi)(l - g )r-2 + (1 -Pi)<7o(l - ri) - g 2 )(l - ri) 
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Figure 7. We take 3 fair games with po = Pi = p, qo = qi = g, and ro = r% = r, and plot 
ln(c(P, Q,R)) = c?3 + d4 - compare Eq.([2.2]), as a function of p, for g = 0.1 and various 
values of r, solid: r — 3/4; crosses: r = 1/2, boxes: r = 1/4; short dashes: r = 1/8; long 
dashes: r = 1/16. We note that composite game is always losing, no matter what p is, for 
a wide range of values of the parameter r. If ln(c(P,Q,R)) is positive (zero) (negative) 
then the game (P,Q,R)) is winning (fair) (losing). 




Figure 8. We take 3 fair games with po = Pi = p, qo = qi = q, and ro = ri = r, and plot 
ln(c(P, Q,R)) = d,3 + d,4 - compare (2.2), as a function of p, for q = 3/4 and various values 
of r: circles: r = 3/4, crosses: r — 5/8; dashes: r — 1/2; solid: r — 3/8. If ln(c(P, Q, R)) is 
positive (zero) (negative) then the game (P,Q,R)) is winning (fair) (losing). 
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Figure 9. We take 3 losing games with po — Pi = P, Qo = 9i = <7> an d r o = r i 



and p 2 = 0.8(1 - p)7((l 



P) 2 + P 2 



g 2 = 0.8(1 - g)7((l - g) 2 + g 2 ), and 
We set g = 3/4, so that g2 = 0.08, and plot 



r 2 = 0.9(1 - r)7((l - rf + r 2 ) 
ln(c(P, Q, R)) = ds + di - compare (2.2), as a function of p for various values of r, circles: 
r = 1/2, (r 2 = 0.45); solid: r = 5/8, (r 2 = 0.238235 . . . ); dashes: r = 3/4, (r 2 = 0.09); 
crosses r — 7/8, (r 2 = 0.018). If ln(c(P, Q, R)) is positive (zero) (negative) then the game 
(P,Q,R)) is winning (fair) (losing). 
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Hence we define the walk in periodic environment by Y n = , and determine 
its transient / recurrent properties by investigating locations of the eigenvalues of the 
matrix M = Ai A 2 Ao. Since the walk Y n takes on the values ±3, ±1, R = L = 3, 
and each of the matrices Aj, i = 1, 2, 3 is a 6 x 6 matrix given by 
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Po 

2 



games with 
-P)V((1 

+ r 2 ). We set q = 0.1 so that q 2 = 0.8890 



Pi 
92 



= p, g = qi 
= 0.8(1 - g) 2 /((l 



and 

2\ 



g) 2 + g 

, and plot 



Figure 10. We take 3 losing 
ro = n = r, and p 2 = 0.8(1 - 
and r 2 = 0.9(1 - r) 2 /((l - r) : 
ln(c(P, Q,R)) = d,3 + (I4 - compare (2.2), as a function of p for various values of r, solid: 
r = 3/4, (r 2 = 0.9); box: r = 1/2, (r 2 = 0.45); circles: r = 3/8, (r 2 = 0.66176...); 
crosses r = 1/4, (r 2 = 0.81). If ln(c(P,Q,R)) is positive (zero) (negative) then the game 
(P,Q,R)) is winning (fair) (losing). 



The examples illustrated in figures 7 and 8 show that the game composed de- 
terministically from fair (non-symmetric) games can be fair or losing or winning, 
depending on parameters of the problem. This form of the paradox is not observed 
when composing (deterministically) two or three 2-periodic games. We observe 
even more interesting behaviour when composing deterministically unfair (losing) 
games. Figures 9 and 10 show such examples. 

By varying just one parameter, it is possible to change the composed game from 
losing to winning, change it back to losing, and then back again to winning - cf. 
figure 9. Three state transitions of the composed game have not been observed 
before. 



5. Conclusions 

Given the highly non-linear nature of the recurrence/transience criteria for ran- 
dom walks in periodic environments as a function of the process parameters, it is 
not surprising that any scheme that combines recurrent random walks in periodic 
environment to produce new random walks in periodic environments will produce 
transient processes, except in trivial cases. 

What is surprising to us is that one can find non-trivial cases where random 
walks in periodic environments with negative drift can be combined to form ran- 
dom walks in periodic environments with positive drift, Parrondo's paradox. We 
believe that these reversals arise because combining these processes in the manner 
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described above radically changes the frequency at which transitions are governed 
by probability distributions with positive means, and that future investigations 
should center on investigating these frequencies. It is likely that it will be easier to 
understand this phenomenon in the case of stochastic combinations of the processes 
since these always lead to the study of nearest neighbour random walks in periodic 
environments. 

When a composite game is constructed from simple 3-periodic games, Par- 
rondo's paradox is much more interesting and complex than in the case of 2-periodic 
games. As shown in figure 9, by varying one parameter three state transitions of the 
composed game may be observed. This phenomenon seems to be similar to changes 
of the direction of the current in a multiplicative stochastic ratchet as observed in 
(Klosek & Cox 2000). 

As shown in §3, a game constructed by composing deterministically 2-periodic 
fair games leads to a pseudo-paradox. In general, a game composed from an even 
number of 2-periodic fair games always exhibits a pseudo-paradox (Key & Klosek 
2000). That is, if each simple game is 2-state periodic with an even temporal period, 
then the composite game is constructed only from half of the simple games, and 
the composite game may be winning, or losing, or fair. Moreover, when each of 
the simple games is fair with an odd temporal period, and the composite game 
is composed deterministically, then Parrondo's paradox never occurs. An example 
in §3 of a game composed from 2-state periodic and 3-temporal periodic games 
illustrates this statement. 

D.A. would like to acknowledge funding from the Sir Ross and Sir Keith Smith Fund, 
GTECH, the Australian Research Council and SA Lotteries. Also thanks are due to Prof. 
A.E. Seigman, Stanford University, USA and Prof. J. Maynard Smith, University of Sussex, 
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discussion with Prof. H.E. Stanley's group at Boston University. 
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